Atty. Dkt. No.: 035451-0143 (3673. Palm) 



U.S. PATENT APPLICATION 
for 

USER INTERFACE TECHNIQUE FOR MANAGING AN ACTIVE CALL 



Inventors: Ryan Robertson 
Eric Williams 
Stephane Maes 
Timothy Twerdahl 
Carl Stone 



Atty. Dkt. No.: 035451-0143 (3673. Palm) 



USER INTERFACE TECHNIQUE FOR MANAGING AN ACTIVE 
CALL 

BACKGROUND 

[0001] Handheld computing devices, "palmtops," 
"palmhelds," personal digital assistants (PDAs), or handheld computers 
typically weigh less than a pound and fit in a pocket. These portable 
electronic devices generally provide some combination of personal 
information management, database functions, word processing, and 
spreadsheets as well as communications network connectivity, internet 
connectivity, voice memo recording, and telephony functions. 

[0002] Handheld computing devices may include a 
wireless telephony device permitting the user to make wireless 
communications such as mobile telephone calls or data downloads or 
uploads to a computer network. It is conventional to employ a touch pad, 
touch screen, or handwriting recognition area and/or device to provide 
input to the handheld computer. If no dialing device such as a keypad is 
included, the user may use the touch pad, touch screen, or handwriting 
recognition area to control the wireless telephony device. 

[0003] Ways in which handheld computers may permit 
wireless phone calls without the use of a conventional telephone keypad 
include using the touch screen to select the numbers from those displayed 
on the screen, using the address book function of the device to choose 
the desired number to call, and using a voice recognition system. Other 
ways can include dialing numbers from web pages or other helper 
applications. 

[0004] A handheld computer that includes wireless 
telephony capability also requires the ability to manage the phone calls. 
The management of a single call is straightforward, but efficient 
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management of multiple calls, in particular calls on multiple lines and 
conference calls, requires more sophisticated call management 
functionality. 

[0005] The functions supported by a particular handheld 
computer with wireless telephony capability may correspond to an 
international standard such as Global System for Mobile Communications 
(GSM) standards set forth by the European Telecommunications 
Standards Institute (ETSI). The GSM standards may set forth the 
functionality required by the phone device, leaving it to the device maker 
to determine the most efficient user interface. 

[0006] Conventional cellular phones having a hard keypad 
and small screen may support the call management functions set forth in 
various international standards. However, traditional cellular phones 
typically have a cumbersome method of managing calls because the user 
is limited to a non-touch screen display and twelve button keypad. 
Performing a straightforward function such as adding a new caller to an 
ongoing conference call can involve a series of key presses that are not 
readily apparent to the user. 

[0007] Conventional wireless telephony devices that 
include a graphical user interface with touch screen display allow some 
improvement over the call management capabilities of classic cellular 
phones. These devices may have icons that permit the user to place 
callers on hold, add new callers, conference two callers together, or swap 
between phone lines. However, these devices may not support the full 
functionality required by GSM standards, and further do not typically 
provide a relatively straightforward graphical user interface for accessing 
call management features. 

[0008] Therefore, there is a need for a handheld computer 
with wireless telephony capability that supports the full call management 
functionality set forth in international standards for digital cellular 
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telecommunications systems while also having a user interface that 
permits efficient and easy to understand operation of the various call 
management functions. 

[0009] The teachings herein below extend to those 
embodiments that fall within the scope of the appended claims, regardless 
of whether they accomplish one or more of the above-mentioned needs. 

SUMMARY 

[0010] An exemplary embodiment relates to a portable 
electronic device having a housing, a processor supported by the housing, 
a memory coupled to the processor, and a communications transceiver 
coupled to the processor. The transceiver is configured to support voice 
conference calling between more than two parties. A program stored in 
the memory in running on the processor is configured to provide a user 
interface on the display that is configured to display indicators 
representative of the parties on the conference call. The user interface 
includes a hold area of the display configured to display indicators 
representative of parties on hold and an active area of the display 
configured to display indicators representative of the parties active on the 
conference call. 

[001 1] Another exemplary embodiment relates to a 
method of managing a conference call on a handheld mobile telephone 
device. The method includes the steps of displaying to a user a screen 
including a new call option, initiating a first call at the request of a user, 
and placing the first call on hold at the request of a user and placing an 
indicator representative of the first call in a hold section of the display. 
The method further includes the steps of displaying to a user an available 
section of the display including a new call option, initiating a second call 
at the request of a user by selecting the new call option, and placing an 
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indicator representative of the second call in an active section of the 
display. 

[0012] Further, an exemplary embodiment relates to a user 
interface for a radio enabled handheld computer display screen that 
includes a first screen portion providing a first indicator representative of 
a first call of a conference call and a second screen portion providing a 
second indicator representative of a second call of a conference call. A 
user selectable option is configured to effectuate movement of at least 
one of the first indicator to the other of the first and second screen 
portion. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0013] The invention will become more fully understood 
from the following detailed description, taken in conjunction with the 
accompanying drawings, wherein like reference numerals refer to like 
elements, in which: 

[0014] FIG. 1 is an exemplary front elevation view of a 
handheld computer; 

[0015] FIG. 2 illustrates a basic call management user 
interface screen for a handheld computer; 

[0016] FIGS. 3A-3E illustrate screens associated with the 
management of a single call with a handheld computer; 

10017] FIGS. 4A-4G illustrate screens associated with the 
management of two calls with a handheld computer; and 

[0018] FIGS. 5A-5D illustrate screens associated with the 
management of three or more calls with a handheld computer. 
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DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS 

[0019] Referring to FIG. 1, a portable electronic device, 
shown as, but not limited to, handheld computer 100 is depicted 
according to an exemplary embodiment. Handheld computer 100 may 
include Palm style computers manufactured by Palm, Inc., of Santa Clara, 
California. Other exemplary embodiments may include Windows CE 
handheld computers, or other handheld computers and personal digital 
assistants, as well as mobile telephones, and other mobile computing 
devices. 

[0020] Preferably, handheld computer 1 00 includes 
memory, a processor, and interactive hardware and software that 
performs functions such as maintaining calendars, phone lists, task lists, 
note pads, calculator applications, spreadsheets, games, and other 
applications capable of running on a computing device. Further, handheld 
computer 100 may be configured for such functions as voice memo 
recording and playback as well as communications network connectivity, 
internet connectivity and wireless telephony. 

[0021] Handheld computer 100, depicted in FIG. 1, 
includes a plurality of input function keys 1 12 and a display 1 14 having 
graphical user interface features. Display 1 14 may be provided with a 
touch screen interface that allows a user to select and alter displayed 
content using a pointer, such as, but not limited to, a stylus, a pen tip, a 
fingertip, or other pointing devices. 

[0022] Referring again to FIG. 1 , in an exemplary 
embodiment, display 1 14 also includes a Graffiti™ (or other handwriting 
recognition software) writing section 1 1 8 for tracing alpha-numeric 
characters as input. A plurality of input icons 1 1 6 for performing 
automated or preprogrammed functions maybe be provided on a portion 
of display 1 14. 
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[0023] In an exemplary embodiment, handheld computer 
100 may include an integrated antenna 120 configured to transmit and 
receive wireless communication signals, such as, but not limited to, 
cellular telephone communication signals and other radio frequency (RF) 
communications signals. A communications transceiver (not shown) may 
be coupled to the processor to support such communications. Antenna 
1 20 may further include an indicator light 1 22 integrated into antenna 
1 20 for indicating the transmission and reception of wireless 
communication signals. Further, light 122 may be used to indicate other 
states of handheld computer 100. 

[0024] in an exemplary embodiment, handheld computer 
100 also includes navigation buttons 124 that may be utilized for 
navigating or scrolling of information displayed on display 1 14. Further, 
navigation buttons 1 24 may be programmed for other uses depending on 
the application running on handheld computer 100. 

[0025] Handheld computer 1 00 may be used for any of a 
variety of wireless communications, including, but not limited to, 
communications with the World Wide Web, mobile telephone 
communications, e-mail communications, etc. In an exemplary 
embodiment, a user may use the wireless communication function by 
interacting with display 1 14. Ways in which display 1 14 can be used 
include using a stylus to select numbers on a displayed keypad, selecting 
numbers from an address book, or having preprogrammed numbers 
associated with input icons 1 1 6. 

[0026] Handheld computer 100 may also include a 
conventional telephone keypad permitting manual entry of numbers by 
depressing keys rather than Interacting with the touch screen display 114. 

[0027] In embodiments in which handheld computer 100 
includes wireless telephony capability, an interface is required to permit 
the user to perform the various phone-related functions available on the 
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device. One method of providing the user interface for call management 
may include presenting the user interface on display 1 14. FIGS. 2-5 
depict the various screens associated with the call management user 
interface of an exemplary embodiment. 

[0028] Referring to FIG. 2, an exemplary screen that can 
be used for call management is depicted, showing the baseline state 
when no calls are active. In an exemplary embodiment, this information 
is displayed on touch screen display 114. Display 114 may include a 
battery gauge 202 that shows the battery level of handheld computer 
100, a signal strength icon 204 that indicates the signal strength of the 
phone, and a plurality of other navigation icons 206 that permit the user 
to navigate to other displays. A speaker icon 208 permits the user to 
adjust the volume of the device, and a mute button 210 permits the user 
to mute the microphone. An add call button 21 2 permits the user to 
initiate a new call. 

[0029] The screen depicted in FIG. 2 is divided into two 
portions, an upper portion shown as upper bucket 200, and a lower 
portion, shown as lower bucket 201 . Upper bucket 200 and lower 
bucket 201 are used to logically divide information displayed on 
exemplary screens in FIGS. 2-5. FIG. 2 includes no caller information in 
either upper bucket 200 or lower bucket 201 because there are no active 
calls. Upper bucket 200 and lower bucket 201 may be labeled "line 
available" to indicate the availability of two phone lines, each 
corresponding to one of the buckets 200, 201 . 

[0030] In the wireless phone embodiment depicted in 
FIGS. 2-5, handheld computer 100 can include two lines available to host 
wireless phone calls. A single line may support a conference call and 
therefore be hosting multiple calls, although only one line can support a 
conference call at a given time. Bucket 200 and bucket 201 each display 
information corresponding to a different one of the phone lines. The 
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division of information into buckets 200 and 201 aids the user in call 
management as will become apparent with the description of FIGS. 3-5. 

[0031] Referring to FIGS. 3A-3E, a number of exemplary 
screens depict the call management user interface for handling a single 
call. FIG. 3A depicts the baseline screen shown in FIG. 2, where the user 
may depress the add call button 212 to initiate a new call. Placing a call 
to a particular party can include choosing a name from an address book, 
tapping numbers on a displayed keypad, writing numbers into writing 
section 118 (see FIG. 1) using a stylus, or using a voice recognition 
system. Tapping the add call button 21 2 will permit the user to choose 

Ci the type of dial sequence desired for initiating the call. 

2 [0032] In addition to tapping the add call button 21 2, 

another way of connecting to a new call is to receive an external call. 
When an external call is received by handheld computer 100, handheld 

Q computer 100 will transfer the currently active call (if any) to on hold 

U status to permit user to receive the external call if a line is available. In 

this way, the reception of an external call results in a similar functionality 

21 to tapping the add call button 21 2. If a free line is not available, or if the 

user decides not to answer external call, the call will be routed to voice 
mail. 

[0033] FIG. 3B depicts the user interface once a single call 
is active. The call indicator phone number, name, or other identifying 
graphic) is displayed in upper bucket 200, while lower bucket 201 
indicates that a line is available. A call timer indicating the elapsed time 
of the call may be displayed as well. An end button 302 will disconnect 
the active call, 

[0034] Once a call is active, as depicted in FIG. 3B, a hold 
icon, shown as, but not limited to, hold button 304 will permit the user to 
place the active line on hold as depicted in FIG. 3C. When the active line 
is placed on hold, the screen will so indicate and a talk button 306 will 

-8- 
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appear (see FIG. 3C) to permit the user to move the on hold call back into 
active call status as depicted in FIG. 3D. 

[0035] If the user taps on a call identifier (e.g. identifier 
"2345678901 " shown in upper bucket 200 of FIG. 3D), screen 3E will be 
displayed. Button 308 will permit the user to create a note to be stored 
in the memory of handheld computer 100. If a note is already present for 
the particular contact associated with the call identifier, the previously 
created note will be displayed. If the contact is not in the address book 
of handheld computer 100, the user may save the caller's information to 
the address book. Rediai reminder button 310 may be used to set a redial 
reminder for the particular caller. Disconnect call button 312 permits the 
user to disconnect the call. 

[0036] FIGS. 4A-4G depict the call management user 
interface for handling two calls. FIG. 4A is similar to FIG. 3C and includes 
add call button 212 that permits the user to use a dial application to 
connect a new active call on the available line. Tapping add call button 
212 automatically places the active call on hold (if not already on hold as 
depicted in FIG. 4A) to permit the user to place the new call, moving the 
call identifier to lower bucket 201 . The new call will be displayed in 
upper bucket 200 as shown in FIG. 4B, as upper bucket 200 generally 
displays the active line. Still referring to FIG. 48, because both lines are 
in use (one active, the other on hold), swap button 406 will be displayed 
between buckets 200 and 201 . Tapping swap button 406 will swap the 
calls such that the on hold call is swapped into the upper bucket 200 and 
becomes active, and the active call is swapped to the lower bucket 201 
and is placed on hold as shown in FIG. 4C. 

[0037] Referring to FIG. 4C, tapping conference button 
404 moves the call currently on hold from lower bucket 201 into upper 
bucket 200. The calls are conferenced together on a single line 
permitting the user and both callers to all talk to each other. The graphic 
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depicting this setup is sinown in FIG. 4D. Because the on hold call from 
lower bucket 201 now resides in upper bucket 200 with the previously 
active call, one of the two phone lines is again available. The availability 
of one of the two phone lines is depicted in FIG. 4D by labeling lower 
bucket 201 "line available." Rather than swap button 406, hold button 
304 is again disposed between upper bucket 200 and lower bucket 201 . 
Tapping hold button 304 will move the entire active conference call into 
on hold status in lower bucket 201 as shown in FIG. 4E. The on hold 
callers can talk to each other while in this state. Tapping talk button 306 
will permit user to again join conference call, as depicted in FIG. 4D. 

[0038] While a conference call is active, as shown in FIG. 
4D, the user may tap on one of the listed contacts to display a call 
actions screen, shown in FIG. 4F. FIG. 4F is similar to FIG. 3E with the 
exception that the user may tap FIG. private conversation button 408 to 
extract a caller from the conference call line, thereby placing the 
conference call on hold and connecting the user with the individual caller. 
Tapping private conversation button 408 brings up the screen depicted in 
FIG. 4G, wherein the remaining caller from the original conference call is 
on hold, depicted in lower bucket 201, and the contact on which the user 
tapped originally is in active conversation with the user, depicted in upper 
bucket 200. Note that FIG. 4G is similar to FIG. 4C in that swap button 
406 is again displayed. Tapping cancel button 410 in call action FIG. 4F 
will revert the user back to the original state of the conference call prior 
to tapping on one of the contact names. 

[0039] FIGS. 5A-5D depict the user interface for managing 
more than two callers. While a conference call is active on one line and 
the other line is available, as shown in FIG, 5A, the user may depress add 
call button 402 to call a third caller. When the add call button 402 is 
tapped, the active conference call is automatically placed on hold, 
depicted in lower bucket 201, and the new call is placed in active call 
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status and depicted in upper bucket 200, as shown in FIG. 5B. With the 
conference call on hold and a single caller in active status as depicted in 
FIG. 5B, swap button 406 is displayed between buckets 200, 201 and 
may be activated by the user. 

[0040] Further referring to FIG. 5B, if the user taps 
conference button 404, the upper bucket 200 caller will be added to the 
ongoing conference call, which will become active, permitting the user to 
participate as depicted in FIG. 5C. The conference call is depicted in 
upper bucket 200. A line then becomes available for the user to add yet 
another caller by tapping add call button 402. Tapping end button 302 
will end the entire conference call. If the user taps add call button 402 
and uses a dialer application to add another caller, the conference call will 
be automatically placed on hold, depicted in lower bucket 201, and the 
new caller put into the active call mode, depicted in upper bucket 200, 
using the same steps as detailed with respect to FIGS. 5A and 5B. The 
user may then swap the active call and conference call or conference the 
active call into the conference call. If the user conferences the new call 
into the ongoing conference call, there will then be four active calls on the 
conference call as depicted in FIG. 5D. 

[00411 In an exemplary embodiment, handheld computer 
100 may support a conference call including four callers on one line along 
with a separate call with a single caller on another line. This functionality 
fully supports GSM international standards, but may be subject to the 
support limitations of particular wireless carriers. 

[0042] Regardless of how many callers are on a 
conference call, if the user taps one of the contact identifiers listed, a call 
actions screen will be called up similar to that shown in FIG. 4F to permit 
separating a caller from the conference call for a private conversation, or 
disconnecting a single caller out of an ongoing conference call. When 
multiple callers are on a conference call, display 14 will automatically 
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reduce the font size for the contact names listed to support the larger 
amount of information displayed to the user. 

[0043] The user interface discussed above with respect to 
FIGS. 2-5 is created through the execution of software residing on hand 
held computer 100. The software used to effectuate the interface may 
be part of an operating system, such as PALM OS, or may be a program 
loaded separately onto handheld computer 100. The software may be 
developed in any number of conventional programming languages. In 
other embodiments, the user interface instructions may be carried out by 
hard wired circuitry or a combination of circuitry and software. 

[0044] The user interface described herein addresses the 
needs of the conventional art by presenting a user interface that allows 
call management supporting the full functionality set forth by GSM 
international standards. Further, the combination of a graphical user 
interface with touch screen capability permits a more efficient and user 
friendly call management interface than available on conventional devices, 
particularly cellular phones. 

[0045] While the detailed drawings, specific examples and 
particular formulations given describe exemplary embodiments, they serve 
the purpose of illustration only. The hardware and user interface 
configurations shown and described may differ depending on the chosen 
performance characteristics and physical characteristics of the computing 
devices. For example, the various buttons or Icons described above that 
effect various call management options may be labeled in various ways to 
Indicate the option being selected. Further, the icons or buttons may be 
located in different portions of display 14 depending on the chosen user 
interface. The systems shown and described are not limited to the 
precise details and conditions disclosed. Furthermore, other substitutions, 
modifications, changes, and omissions may be made in the design, 
operating conditions, and arrangement of the exemplary embodiments 
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without departing from the scope of the invention as expressed in the 
appended claims. 
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